ON ORNSTEIN-UHLENBECK DRIVEN BY 
ORNSTEIN-UHLENBECK PROCESSES 



BERNARD BERCU, FREDERIC PROIA, AND NICOLAS SAW 



Abstract. We investigate the asymptotic behavior of the maximum likelihood 
estimators of the unknown parameters of positive recurrent Ornstein-Uhlenbeck 
processes driven by Ornstein-Uhlenbeck processes. 



1. INTRODUCTION AND MOTIVATION 



Since the seminal work of Ornstein and Uhlenbeck [17], a wide literature is avail- 
able on Ornstein-Uhlenbeck processes driven by Brownian or fractional Brownian 
motions [12] , [S] ■ Many interesting papers are also available on Ornstein-Uhlenbeck 
processes driven by Levy processes 

(1.1) dX t = 6X t dt + dL t 

where 6 < and (L t ) is a continuous-time stochastic process starting from zero with 
stationary and independent increments. We refer the reader to Barndorff- Nielsen 
and Shephard j2] for the mathematical foundation on Ornstein-Uhlenbeck processes 
driven by Levy processes, and also to pQ for a recent extension to fractional Levy 
processes. Parametric estimation results for Ornstein-Uhlenbeck driven by a-stable 
Levy processes are established in [10] whereas nonparametric estimation results are 
given in [11]. Two interesting applications related to money exchange rates and 
stock prices may be found in [2] and [15], see also the references therein. 

To the best of our knowledge, no results are available on Ornstein-Uhlenbeck 
driven by Ornstein-Uhlenbeck processes defined, over the time interval [0, T], by 



1.2] 




6X t dt + dV t 
pV t dt + dW t 



where 9 < 0, p < and (Wt) is a standard Brownian motion. For the sake of 
simplicity and without loss of generality, we choose the initial values Xq = and 
Vo = 0. Our motivation for studying ( jl.2p comes from two observations. On the one 
hand, the increments of Ornstein-Uhlenbeck processes are not independent which 
means that the weighted maximum likelihood estimation approach of [TU] does not 
apply directly to our situation. On the other hand, Ornstein-Uhlenbeck driven by 
Ornstein-Uhlenbeck processes are clearly related with stochastic volatility models 
in financial mathematics [16]. Furthermore, (ll.2p is the continuous-time version of 
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the first-order stable autoregressive process driven by a first-order autoregressive 
process recently investigated in [3J. 

The paper organizes as follows. Section [2] is devoted to the maximum likelihood 
estimation for 9 and p. We also introduce the continuous-time Durbin- Watson statis- 
tic which will allow us to propose a serial correlation test for Ornstein-Uhlenbeck 
driven by Ornstein-Uhlenbeck processes. In Section [3J we establish the almost sure 
convergence as well as the asymptotic normality of our estimates. One shall realize 
that there is a radically different behavior of the estimator of p in the two situa- 
tions where p < and p = 0. Our analysis relies on technical tools postponed to 
Section HI Finally, in Section [51 we propose a statistical procedure based on the 
continuous-time Durbin- Watson statistic, in order to test whether or not p = 0. 

2. MAXIMUM LIKELIHOOD ESTIMATION 
The maximum likelihood estimator of 9 is given by 

(2.1) ? T -ti X > iX '- X2 r- T 



fJXfdt 2 /„' A? At 

In the standard situation where p = 0, it is well-known that 9t converges to 9 almost 
surely. Moreover, as 9 < 0, the process (X?) is positive recurrent and we have the 
asymptotic normality 

Vt(9 t -9^ -^N(0,-26). 

We shall see in Section |3J that the almost sure limiting value of 9t and its asymptotic 
variance will change as soon as p < 0. The estimation of p requires the evaluation of 
the residuals generated by the estimation of 9 at stage T. For all < t < T, denote 

(2.2) V t = X t - 9 T Y, t 
where 

(2.3) Et= / X s ds. 



o 



By analogy with (12. ip and on the basis of the residuals (12. 2p . we estimate p by 

VS-T 

(2.4) p T - 



2/ T ^dt 

Therefore, we are in the position to define the continuous-time version of the discrete- 
time Durbin- Watson statistic [3J, [5], [6], [7], 

2.5 D T = Jo 1 T ^ ^ , 

which clearly means that = 2(1 — pr). In Section [3J we shall make use of D T 
to build a serial correlation statistical test for the Ornstein-Uhlenbeck driven noise, 
that is to test whether or not p = 0. 
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3. MAIN RESULTS 

The almost sure convergences of our estimates are as follows. 
Theorem 3.1. We have the almost sure convergences 
(3.1) lim 9t = 0*, lim p T = p* a.s. 

where 

f) P (e + P ) 



(3.2) J. = S + , and p-: (e + p)2 + ep 
Proof. We immediately deduce from (jl.2p that 

(3.3) f X t dX t = 9S T + pP T + 

Jo 



where 

(3.4) S T = [ X t 2 dt, P T = I X t V t dt, M* = I X t dW t . 

Jo Jo Jo 

We shall see in Corollary 14.11 below that 

1 1 

(3.5) lim —St = 77, r a.s. 

v ; t->ooT 2(9 + p) 

and in the proof of Corollary 14.21 that 

(3.6) lim —Pt = 77. r a.s. 

v ; t^ooT 2(9 + p) 

Moreover, if (J-" t ) stands for the natural filtration of the standard Brownian motion 
(Wt), then (M t x ) is a continuous-time (J 7 t)~ martingale with quadratic variation 
St- Hence, it follows from the strong law of large numbers for continuous-time 
martingales given e.g. in [8] or [13], that = o(T) a.s. Consequently, we obtain 
from flU]) that 

(3.7) lim — / Xt dX t = — j— - — - = — a.s. 

v ; t^ooT J 2(9 + p) 2(9 + p) 2 

which leads, via (12. ip . to the first convergence in (13. ip . The second convergence in 
(13. ip is more difficult to handle. We infer from (jl.2p that 

(3.8) / V t dV t = pL T + 



where 

(3.9) L T = I V t z dt and — I V t dW t . 



T r T 

2 







On the one hand, if p < 0, it is well-known, see e.g. [8] page 728, that 
(3.10) lim l-L T = -— a.s. 

T^oo I Ip 
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In addition, (M^) is a continuous-time (J-" t )— martingale with quadratic variation 
L t . Consequently, My = o(T) a.s. and we find from (13.81) that 

(3.11) lim 1 / V t W = ~ a.s. 

However, we know from Ito's formula that 

T X t dX t = U?$-l) and ll T V t m- lfVT2 



T J 2 V T J T Jo 2 

Then, we deduce from (13.71) and (13. lip that 

X 2 V 2 

(3.12) lim — = and lim — = a.s. 

As X T = 6E T + V T , it clearly follows from (J2~2]) and (13~T2|) that 

(3.13) to. -l)=-i a., 



Hereafter, we have from (12. 4p the decomposition 
(3.14) p T 



T (V 2 



T 



2L T \T 
where 

V t 2 dt. 

o 

We shall see in Corollary 14.21 below that 

(3.15) lim — Lt = a.s. 

V 7 T^ooT 2p* 

Therefore, (I3.14p together with (13.131) and (13.151) directly imply (13. ip . On the other 
hand, if p = 0, it is clear from (11.21) that for all t > 0, V t = W t . Hence, we have 
from (I2.2p and Ito's formula that 

(3.16) V T 2 — T = 2Mjf - 2W T Z T (6 T -9) + Y? T {6 T - 9) 2 



T fT 

2/^2 



and 

(3.17) L T = L T -2(9 T -9) I W t E t dt + (9 T - 9f I Yi 2 t dt 

Jo Jo 

where 

W 2 dt and = [ W t dW t . 

o 



It is now necessary to investigate the a.s. asymptotic behavior of Lt- We deduce 
from the self- similarity of the Brownian motion (Wt) that 

(3.18) L T = [ W 2 dt = T [ W 2 /T dt = T 2 [ W 2 ds = T 2 L 

Jo Jo Jo 
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Consequently, it clearly follows from ( 13.18P that for any power < a < 2, 



(3.19) lim — L T = +oo a.s. 

As a matter of fact, since L is almost surely positive, it is enough to show that 



(3.20) 



lim E 

T^oo 



exp(-^L a 



0. 



However, we have from standard Gaussian calculations, see e.g. [14] page 232, that 



E 



exp 



E 



( T \ 



1 



A/cosh(t>y(a)) 



where vt{cl) = V2T 2 " a goes to infinity, which clearly leads to (13.201) . Furthermore, 
(M^) is a continuous-time (J-^)— martingale with quadratic variation L t . We already 
saw that Lt goes to infinity a.s. which implies that Mjf = o(Lt) a.s. In addition, 
we obviously have H T < TSt- One can observe that convergence (13. 5ft still holds 
when p — 0, which ensures that H T < T 2 a.s. Moreover, we deduce from the strong 
law of large numbers for continuous-time martingales that 

logT" 



{Or- 



T 



a.s. 



which implies that T, t (6t — 0) 2 = 0(T log T) = o{Lt) a.s. By the same token, as 
X T = o(T) and W T = o(T log T) a.s., we find that 



W T Z T {0 T -6) = o{L T ) 
Consequently, we obtain from ( 13. 16p that 
(3.21) V T 2 -T = o(L T ) 



a.s. 



a.s. 



It remains to study the a.s. asymptotic behavior of Lt- One can easily see that 



J T? t dt<j 2 {S T + L T ). 



However, it follows from ( 13. 5 p and (13 . 1 9[) that St = o(Lt) a.s. which ensures that 

-T 

Y? t dt = o(L T ) 



(3.22) (6 T 
Via the same arguments, 

(3.23) (6 T - 



W t E t dt = o(L T ) 



a.s. 



a.s. 



Then, we find from ( l3~TTj) . (13T22|) and (13T23|) that 
(3.24) L T = L T {1 + o(l)) a.s. 

Finally, the second convergence in (13. ip follows from (I3.2ip and (13.241) which achieves 
the proof of Theorem 13.11 □ 

Our second result deals with the asymptotic normality of our estimates 
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Theorem 3.2. If p < 0, we have the joint asymptotic normality 

(3.25) ^i-' 6 **) ^(o,r) 

\Pt - P J 

where the asymptotic covariance matrix 

(3.26) r 



-I 



wtih al = -29*, i = 2p * / [ {9 7~ dp) and 



a 



2 



2p* ((6*) 6 + 9p ((6*y - 6p (2(6*) 2 - 6p))) 



p {{6*f + 6pf 

In particular, we have 

(3.27) VT (e T - 9*^ -A Af (0, o\ 



and 



(3.28) Vr(p T - pA Af(0, 



° P )- 



Proof. We obtain from (12.1 ft the decompostion 

i\/fX pi 

(3-29) 0T -9* = ^L + ihL 

where 

dp, 

2 

We shall now establish a similar decomposition for pr — p*. It follows from (12. 2|) 
that for all < t < T, 



R$ = p[ X t (V t -X t )dt = -9p I E t dEt = -^E|. 
Jo Jo 



v t = x t -e T E t = v t -{e T -e)E t = v t -(e T -e*)?: t -pz t1 

= v t - p -[x t - v t ) - l -(e T - e*){x t - v t ) = e -v t - p -x t - l -{e T - e*)(x t - v t ), 

which leads to 

(3.30) L T = I T + (6 T - 6*) (j T + (fi T - 0*)K T 

where 

— 

e 2 



It = ^[p 2 S T + (9*) 2 L T -29*pR 
Jt = ^(2pS T + 28*L T -2(8 + 2p)P T 
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(3.31) L T (p T - p *) = JL + _(0 T _ 6*) (4 + (6 T - 9*)K% 



Then, we deduce from ( 12. 4p and (13.30}) that 

1% 1 

f + 2 l 

in which 1% = V T 2 - T - 2p*I T , J% = -2p*J Tl and K$ = -2p*K T . At this stage, 
in order to simplify the complicated expression (13.31 j) . we make repeatedly use of 
Ito's formula. For all < t < T, we have 

L t = ±V t 2 --M? --, 
2p 1 p 1 2p 

Pt = ¥ XtVt ~ W v * ~ ¥ M * - W> 



—X 2 + - V 2 —X V - —M x — 

26 1 29*9 % 9*9 1 1 9* * 29* 



where the continuous-time martingales and MY were previously defined in (13 .4|) 
and (13.91) . Therefore, it follows from tedious but straightforward calculations that 

(3.32) L T (pr - p*) = C X M% + C V M^ + -y (0 r - 9*) + i# 

where 

and C - + M 



9 2 p 9 2 9* 
The remainder R}£ is similar to and they play a negligible role. The combination 
of (I3.29P and (I3.32p leads to the vectorial expression 

(3.33) VT (t T ~ 6 l) = -^=A T Z T + VTR T 



where 

A T =( ^ T , ° x ), Rt= ( S A R * 

with B T = C x + JY(2S T )~ 1 and D T = B% + J^(2St)~ 1 R^. The leading term in 
( I3.33P is the continuous-time vector (J^)— martingale (Z t ) with predictable quadratic 
variation (Z) t given by 

Z t = ( S) and (Z) 



M t v J " " x ,l \P t Lt 
We deduce from (j3T5|) . (I3T6|) and ( IBTTUj) that 

(3.34) lim A T = A a.s. 

T— > oo 

where A is the limiting matrix given by 

-29* 

By the same token, we immediately have from ( 13. 5p . ( 13. 6 j) and (13. 10[) that 

(3.35) \[ m !^h = A = — 1 (] 1 ) a. s . 



A 



-2p*(C x - 2(9p)' 1 9*p*) -2p*CV 
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Furthermore, it clearly follows from Corollary 14.31 below that 

3.36 —, = -U and -£= -U 0. 

y/T VT 

Finally, as T = AAA', the joint asymptotic normality (13. 25ft follows from the con- 
junction of (13.331) . (13.341) . (13 .35 p . (I3.36j) together with Slutsky's lemma and the 
central limit theorem for continuous-time vector martingales given e.g. in [8], which 
achieves the proof of Theorem 13.21 □ 

Theorem 3.3. If p — 0, we have the convergence in distribution 
(3.37) Tp T -^W 
where the limiting distribution W is given by 

fiB.dB. Bl-1 



(3.38) W 



f*B?ds 2 ft B*ds 
and (B t ) is a standard Brownian motion. 

Proof. Via the same reasoning as in Section 2 of [9], it follows from the self-similarity 
of the Brownian motion (W t ) that 

^V, 2 dt,i(Fy T 2 -T)) £ (Tj\ t j T dt, -(wtf-i) 

(3.39) = (r 2 ^W s 2 ds, \{W?-l) 

Moreover, we obtain from (13.301) that 

(3.40) L T = cvtSt + PtPt + 7t-^t 



where 



\ (fir ~ Of, 
2 2 



= -j(o T -e)-^(e T -ef, 



By Theorem 13. 1[ 9t converges a.s. to 6 which implies that cut, /3t, and jt converge 
a.s. to 0,0 and 1. Hence, we deduce from (13.51) . (13. 6p and (I3.40p that 

(3.41) L T = L T (1 + o(l)) a.s. 

Furthermore, one can observe that V T 2 /T shares the same asymptotic distribution as 
Wrf/T. Finally, (I3.37j) follows from (I3.39j) and (13.41 j) together with the continuous 
mapping theorem. □ 
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Remark 3.1. The asymptotic behavior of pr when p < and p = is closely re- 
lated to the results previously established for the unstable discrete-time autoregressive 
process, see jl], [9], [18]. According to Corollary 3.1.3 of jl], we can express 

T 2 - 1 

w = 

2S 

where T and S are given by the Karhunen-Loeve expansions 

oo oo 

T = V2 lnZ n and S = ^ ll Z l 

n=l n=l 

with 7„ = 2(— l) n /((2n — l)ir) and (Z n ) is a sequence of independent random vari- 
ables withj\f(0, 1) distribution. 

Remark 3.2. For all < t < T , the residuals V t given by (12. 2p depend on 6?. It 
would have been more natural to make use of the estimator of 9 at stage t instead 
of stage T, in order to produce a recursive estimate. In this situation, Theorem \3.1\ 
still holds but we have been unable to prove Theorem \3.2 . 

4. SOME TECHNICAL TOOLS 
First of all, most of our results rely on the following keystone lemma. 
Lemma 4.1. The process (X t ) is geometrically ergodic. 
Proof. It follows from ( II. 2p that 

(4.1) dX t = (6 + p)X t dt - 9pL t dt + dW t 



where we recall that 



Consequently, if 



t 

X, ds. 



o 



X t 



we clearly deduce from (14. ID that 

d$ t = A$ t dt + dB t 

where 

, fe + p -6 P \ , fw t 
A ={ i o ) and B *={o 

The geometric ergodicity of ($ t ) only depends on the sign of A max (v4), i.e. the largest 
eigenvalue of A, which has to be negative. An immediate calculation shows that 

Amax(-4) = max(6 l , p) 

which ensures that \ max (A) < as soon as p < 0. Moreover, if p = 0, (Xt) is 
an ergodic Ornstein-Uhlenbeck process since 6 < 0, which completes the proof of 
Lemma 14.11 □ 
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Corollary 4.1. We have the almost sure convergence 

(4.2) lim -S T = 777^ — r a.s. 

v ' t^ooT 2(9 + p) 

Proof. According to Lemma 14. 1\ it is only necessary to establish the asymptotic 
behavior of E[X t 2 }. Denote a t = E[X t 2 }, t = E[S t 2 ] and j t = E[X t E t ]. One obtains 
from Ito's formula that 

f-CU t + I 

where 

'2(0 + p) -29 p 
U t = I 0t I , C = I 2 








)■ H 









1 -Bp e + P/ 

It is not hard to see that A max (C) = max(# + p, 29, 2p). On the one hand, if p < 0, 
Amax(C) < which implies that 



lim U t = -C~ X I. 

t—¥ 00 



It means that 



lim a t = -7577^ — r, lim (3 t = - ,} — r, lim j t = 0. 

t^oo 2(9 + p) t^oo 29p(9 + p) 

Hence, (14. 2 p follows from Lemma 14.11 together with the ergodic theorem. On the 
other hand, if p = 0, (X t ) is a positive recurrent Ornstein-Uhlenbeck process and 
convergence (14.21) is well-known. □ 

Corollary 4.2. If p < 0, we have the almost sure convergence 

1 (fl + p )2 + g p 

lim — Lt = — 77. r— a.s. 

T-+00T 29p(9 + p) 

Proof. If p < 0, (Vt) is a positive recurrent Ornstein-Uhlenbeck process and it is 
well-known that 

lim — Lt = a.s. 

r^ooT 2p 

In addition, as X t = 9H t + V t , 

X t Z t dt = ^(S T -P T ). 

However, we already saw in the proof of Corollary 14.11 that 

1 <- T 



lim — / X t H t dt = a.s. 

T^ooT J 

which leads, via ( 14.21) . to the almost sure convergence 

r Pt 1 

hm — — = — r a.s. 

T^oo T 2(9 + p) 
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Consequently, we deduce from ( 13.1 ft together with ( 13.301) that 

lim — Lt = lim — It = 7—77; r— a.s. 

t^ooT t^ooT 26p(6 + p) 

which achieves the proof of Corollary 14.21 □ 
Corollary 4.3. If p < 0, we Ziaue the asymptotic normalities 

The asymptotic normality of Xt still holds in the particular case where p = 0. 

Proof. This asymptotic normality is a well-known result for the Ornstein-Uhlenbeck 
process (Vt) with p < 0. In addition, one can observe that for all t > 0, E[X*] = 0. 
The end of the proof is a direct consequence of the Gaussianity of (X t ) together 
with Lemma 14.11 and Corollary 14.11 □ 



5. A STATISTICAL TESTING PROCEDURE 

Our purpose is now to propose a statistical procedure in order to test 

H : "p = 0" against U x : "p < 0" . 

We shall make use of the Durbin- Watson statistic given by (12. 5p . Its asymptotic 
properties follows. 

Theorem 5.1. We have the almost sure convergence 

(5.1) lim D T = D* a.s. 

T— » 00 

where D* = 2 (1 — p*). In addition, if p < 0, we have the asymptotic normality 

(5.2) VT (p T - D*\ AT(0, <J 2 D ) 
where 

cr n = 4cr. = o . 

p ((9*y + e P f 

while, if p = 0, 

(5.3) T (d t -2) -2W 



with W given by (I3.38j) . 

Proof. The proof of Theorem l5.1l is a straightforward application of ( 13. ip . (I3.28|) and 
( 13TB7P since D T = 2(1- p T ). □ 
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From now on, let us define the test statistic 



Z T = T 2 (D T -2 V 



It follows from Theorem 15. II that under H , 
while, under %x, 



lim Zt = +00 a.s. 

T-s-oo 

From a practical point of view, for a significance level a where < a < 1, the 
acceptance and rejection regions are given by A = [0, z a ] and 1Z =}z a , +00 [ where 
z a stands for the (1 — a)-quantile of the distribution of AW 2 . The null hypothesis 
Ho will not be rejected if the empirical value 

Z T < z a , 

and will be rejected otherwise. Assume to conclude that %o is rejected, which means 
that we admit the existence of a serial correlation p < 0. Then, the best way to 
produce unbiased estimates is to study the process given by (14.11) . As a matter of 
fact, for all t > 0, 

x t = (e + p)z t -e P n t + Wt 

where ^ ^ 

E 4 = / X s ds and H t — S s ds. 
Jo Jo 
The maximum likelihood estimator of the vector 

is given by 

d T = ( [ / $ t dx t 



where $ 4 = (X t S t ) . We can show the almost sure convergence 

lim 

as well as the asymptotic normality 



lim — $ a -s. 



VT (d T - &\ Af(0, A) 

where the asymptotic covariance matrix is given by 

_ (-29* 
V -29 p 9* 

Accordingly, the maximum likelihood estimator is strongly consistent and one 
can see that its components are asymptotically independent. 
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